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SUMMARY 


A  major  operational  need  facing  the  next  generation  of  Scout  (ASH)  and 
Attack  (AAH)  helicopters  is  to  detect  targets  from  nap-of -earth  altitudes,  on 
a  realistic  battlefield  in  a  complex  and  cluttered  scene.  The  current  technology 
base  supports  the  development  of  a  complement  of  sensors  spanning  a  region  of 
the  spectrum  from  visible  to  far  infrared.  Precision  pointing  and  stabiliza¬ 
tion  has  been  demonstrated  to  insure  that  target  detection  and  recognition 
requirements  can  be  met.  However,  the  problem  for  the  operator  to  detect  low 
contrast  targets  in  a  complex  and  cluttered  scene  at  long  ranges  and  minimum 
exposure  time  to  insure  adequate  survivability  still  exists.  The  targets  of 
interest  here  are  primarily  the  single,  high  threat  target  which  will  not  be 
contained  with  the  main  body  of  target  tanks  and  will  not  present  many  detection 
cues.  This  work  is  oriented  primarily  for  TADS  type  acquisition  systems  for 
airborne  missile  fire  control,  although  it  has  general  application  to  any  video 
format  imaging  system.  It  holds  high  potential  for  improving  target  signature 
for  seeker  lockon  and  tracking  and  can  possible  simplify  correlation  techniques 
for  missile  seeker  handoff  by  preprocessing  the  seeker  and  sensor  imagery. 

Image  processing  techniques  offer  potential  for  improved  performance 
through  target  acquisition  (autonomous  or  man-in-loop)  at  greater  standoff 
ranges  or  in  less  time  and  through  automatic  handoff  of  identified  targets 
from  precision  pointing  and  tracking  system  to  the  missile  seeker.  For  this 
work  the  emphasis  is  on  man-in-loop  target  acquisition.  Under  the  constraint  of 
real-time  or  near  real-time  operation,  specific  image  processing  methods  have 
been  identified  for  analysis  and  evaluation  in  terms  of  improved  performance 
by  a  human  observer  seeking  to  detect /recognize  targets  in  a  cluttered  back¬ 
ground  under  marginal  viewing  conditions. 
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Six  specific  image  enhancement  algorithms  were  analyzed,  simulated  and 
evaluated  for  potential  real-time  application  to  imagery  obtained  from  target 
acquisition  systems.  As  a  result  of  this  effort,  three  processing  methods 
are  recommended  as  operator  controlled  options  for  application  to  the  imagery. 
One  method  is  a  median  filter,  which  reduces  noise  without  blurring  edge  detail. 
The  other  method  is  an  adaptive  edge  processor  operating  on  the  image  gradient. 
The  third  method  is  local  area  gain  control  with  a  mean  dependent  gain  term. 


PREFACE 


This  final  technical  report  describes  the  objectives,  methods  and  results 
of  contract  DAAH01-80-C-1143  on  "Research  on  Image  Enhancement  Algorithms" 
and  covers  the  period  9  July  1980  to  31  May  1981.  This  effort  was  conducted  by 
the  Gas  Diagnostics  Research  Division  of  the  University  of  Tennessee  Space 
Institute,  Tullahoma,  Tennessee  37388.  It  was  sponsored  by  the  Guidance  and 
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1.  INTRODUCTION  AND  EXECUTIVE  SUMMARY 


This  final  technical  report  describes  the  objectives,  methods  and  results 
of  contract  DAAH01-80-C-1143  on  "Research  on  Image  Enhancement  Algorithms" 
and  covers  the  period  9  July  1980  to  31  May  1981.  Six  specific  image 
enhancement  algorithms  were  analyzed,  simulated  and  evaluated  for  potential 
real-time  application  to  imagery  obtained  from  target  acquisition  systems. 

As  a  result  of  this  effort,  three  processing  methods  are  recommended  as 
operator  controlled  options  for  application  to  the  imagery.  One  method  is 
a  median  filter,  which  reduces  noise  without  blurring  edge  detail.  The  other 
method  is  an  adaptive  edge  processor  operating  on  the  image  gradient.  The  third 
method  is  local  area  gain  control  with  a  mean  dependent  gain  term. 

Details  of  the  six  methods  investigated  and  evaluation  comparisons  are 
given  in  the  reamining  sections  of  this  report. 

1.1  Application  and  relation  to  performance.  A  major  operational  need  facing 
the  next  generation  of  Scout  (ASH)  and  Attack  (AAH)  helicopters  is  to  detect 
targets  from  nap-of-earth  altitudes,  on  a  realistic  battlefield  in  a  complex 
and  cluttered  scene.  The  current  technology  base  supports  the  development 
of  a  complement  of  sensors  spanning  a  region  of  the  spectrum  from  visible  to 
far  infrared.  Precision  pointing  and  stabilization  has  been  demonstrated  to 
insure  that  target  detection  and  recognition  requirements  can  be  met.  However, 
the  problem  for  the  operator  to  detect  low  contrast  targets  in  a  complex  and 
cluttered  scene  at  long  ranges  and  minimum  exposure  time  to  insure  adequate 
survivability  still  exists.  The  targets  of  interest  here  are  primarily  the 
single,  high  threat  target  which  will  not  be  contained  with  the  main  body  of 
target  tanks  and  will  not  present  many  detection  cues.  This  work  is  oriented 
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primarily  for  TADS  type  acquisition  systems  for  airborne  missile  fire  control, 
although  it  has  general  application  to  any  video  format  imaging  system.  It 
holds  high  potential  for  Improving  target  signature  for  seeker  lockon  and 
tracking  and  can  possibly  simplify  correlation  techniques  for  missile  seeker 
handoff  by  preprocessing  the  seeker  and  sensor  imagery. 

Image  processing  techniques  offer  potential  for  improved  performance 
through  target  acquisition  (autonomous  or  man-in-loop)  at  greater  standoff 
ranges  or  in  less  time  and  through  automatic  handoff  of  identified  targets 
from  a  precision  pointing  and  tracking  system  to  the  missile  seeker.  For 
this  work  the  emphasis  is  on  man-in-loop  target  acquisition.  Under  the  con¬ 
straint  of  real-time  or  near  real-time  operation,  specific  image  processing 
methods  have  been  identified^  for  analysis  and  evaluation  in  terms  of  improved 
performance  by  a  human  observer  seeking  to  detect/recognize  targets  in  a 
cluttered  background  under  marginal  viewing  conditions. 

Performance  of  an  observer  in  acquiring  a  target  is  usually  given  in 

2 

terms  of  probabilities  of  specific  subjective  decisions  by  the  observer  . 
Target  acquisition  is  taken  to  mean  the  detection  and/or  recognition  of 
potential  target  classes  by  a  human  observer  viewing  a  display  of  the  imaged 
scene.  Performance  in  terms  of  detection  probability  and  recognition 
probability  can  be  related  to  quantifiable  system  performance  measures  for  the 
sensor  system. 


where  Pj  is  a  search-term  probability  which  depends  on  scene  clutter 
?2  depends  on  contrast 
P^  depends  on  resolution 
depends  on  noise. 
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Based  on  this  model,  image  processing  methods  which  improve  contrast,  resolu¬ 
tion  or  signal-to-noise  are  candidates  for  application  to  the  target  acquisi¬ 
tion  problem.  Definitions  and  properties  for  the  six  processing  methods  are 
given  in  Section  2.  Subjective  and  quantitative  evaluation  measures  are 
discussed  in  Section  3. 


INPUT  IMAGERY 


•Sine  &  Square  Wave 
•TGT  on  Uniform  BKGD 
•TADS  Imagery 
•Noise 


PROCESSORS 

1 .  LAGC 

Contrast 

2.  HIST.  MOD. 

Resolution 

3 .  EDGE-WINDOW 

Enhancement 

4 .  MEDIAN 

5 .  ADAPTIVE  LPI 

“ 

Noise 

I  6 .  WINDOW-SMOOTH 

Reduction 

J 

-  Parallel/Serial  Comginations 

ANALYSIS 

•Predicted  Results 
•Performance  Definitions 

-  Contrast 

-  S/N 

-  Resolution 
•Scene  Dependence 
•Noise  Effects 


HARDWARE 

REAL-TIME 


SIMULATION/EVALUATION 


•Program  Development 

•Application 
•Performance  Comparison 


FIGURE  1.1  Elements  of  image  enhancement  research 
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1.2  Methods  investigated  and  overall  plan.  The  overall  effort  is  outlined 
graphically  in  Figure  1.1.  It  consisted  of  analysis,  simulation  and  evaluation 
of  six  image  processing  methods:  1.  local  area  gain  control  (LAGC) , 

2.  histogram  modification  (HIST),  3.  edge  detection  (EDGE),  4.  median 
filtering  (MED),  5.  adaptive  lowpass  filtering  (ALPF),  and  6.  window 
smoothing  (WIND) . 

Each  processing  method  was  evaluated  individually  to  determine  the  effect 
of  different  parameter  values  on  the  resultant  processed  image.  Additionally, 
the  processors  were  evaluated  in  various  serial  and  parallel  combinations  to 
determine  if  more  than  one  process  should  be  considered  for  implementation. 

Quantitative  measures  of  target-to-background  contrast,  signal-to-noise 
ratio,  target  to  clutter  ratio  and  resolution  were  defined  and  computed  for  the 
imagery  before  and  after  each  processing  step.  Subjective  evaluation  was 
accomplished  in  terms  of  relative  clarity  of  known  target  boards  and/or  vehicles 
in  the  imagery.  A  detailed  description  of  the  imagery  and  the  processor 
simulations  is  given  in  Section  4. 

1.3  Significant  results  and  recommendations.  Of  the  methods  investigated 
for  noise  reduction  median  filtering  offers  the  least  amount  of  image  blurring. 
It  is  therefore  recommended  for  implementation.  Further,  the  noise  reduction 
processing  should  be  done  first  in  the  processing  sequence.  From  that  point 

it  is  recommended  that  further  processing  be  done  and  combined  in  parallel 
with  the  median  filtered  image.  Thus  a  serial-parallel  processing  system 
(median  —  parallel  processing)  is  recommended. 

Options  for  additiona.’  processing  include  LAGC  (with  mean  dependent 
gain)  and  gradient/edge  processing.  The  LAGC  option  with  gain  ■  ^  was 
found  to  introduce  excessive  clutter.  Edge  detection  threshold  based  on 


4 


A/***  % 


statistics  in  a  local  window  produced  results  which  showed  promise  for 
identifying  low-contrast  objects.  Window  size  for  threshold  calculation 
was  found  to  be  very  important  and  should  be  operator  selectable. 

Further  details  of  the  processers  and  performance  are  given  in  subsequent 
sections  of  this  report.  A  recommended  processor  implementation  is  diagrammed 
in  section  5. 


2.  IMAGE  PROCESSING  ALGORITHMS -DEFINITION  AND  PROPERTIES 


The  following  six  processing  methods  were  evaluated  as  part  of  this  effort: 

1.  Local  area  gain  control  -  an  adaptive  contrast  enhancement  method, 

2.  Histogram  modification  -  both  histogram  equalization  and  histogram 
hyperbolization  were  evaluated  for  expected  contrast  enhancement, 

3.  Edge  detection  -  binary  edge  maps  dependent  on  a  threshold  applied 
to  the  gradient  image, 

4.  Median  filtering  -  a  non-linear  filter  for  improving  signal,  to 
noise  with  a  passband  which  is  adaptive  to  scene  content, 

6.  Window  smoothing  -  a  simple  averaging  window  for  reducing  noise. 

2.1  Local  area  gain  control  (LAGC)  -  LAGC  is  a  non-linear  adaptive  processor 
which  is  designed  to  enhance  low-contrast  sub-regions  in  an  image  without  causing 
high  contrast  regions  to  saturate  the  display  dynamic  range.  It  thus  seeks  to 
avoid  the  major  problem  encountered  with  simple  linear  contrast  stretching. 

LAGC  is  a  method  whereby  the  gain  applied  to  the  center  pixel  within  a  window 
varies  with  the  statistics  of  all  pixel  values  in  the  window.  Gain  must  be 
re-computed  for  each  pixel  as  the  window  moves  across  the  image. 

If  the  input  image  f(x,y)  is  processed  to  give  output  image  g(x,y)  then 


LAGC  is  defined  by 

g(x,y)  =  G  j^f(x.y)  -  m^B  (x,y)J  +  kmAB(x,y) 


(2-1) 


where:  -m  (x,y)  is  the  mean  pixel  value  within  an  A  x  B  window  centered 

Ad 

about  pixel  location  (x,y) 

-  G  =  C/S  (x,y)  is  the  adaptive  gain 

AB 

-  S,D(x,y)  is  the  standard  deviation  of  pixel  values  within  the 

AB 

A  x  B  window  centered  at  pixel  location  (x,y) 

-  C  and  k  are  constants  which  control  the  gain  magnitude  and 
relative  mean  value  added  back  to  the  signal. 

The  method  is  diagrammed  in  Figure  2.1 


k 


FIGURE  2.1  Local  area  gain  control  (LAGC)  method. 

An  alternate  version  of  the  LAGC  method  uses  G  =  CmAg(x,y)/S^g(x,y)  as 
the  gain  term  in  (2-1).  Both  versions  were  simulated. 

For  this  effort,  simulations  were  done  for  square  windows  only  (A=B) . 
Window  sizes  of  (3x3),  (5  x  5)  and  (15  x  15)  were  implemented  and  evaluated. 
An  analysis  of  expected  contrast  transfer  for  the  LAGC  method  was  done. 
Results  of  this  analysis  are  given  in  Appendix  A. 
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2.2  Histogram  modification.  Histogram  modification  is  a  point  intensity 
transformation  which  is  designed  to  enhance  image  contrast  based  on  global 
statistics  for  the  image.  The  procedure  is  as  follows. 

If  the  input  image  f(x,y)  has  an  intensity  histogram  p(f),  and  the  out¬ 
put  image  g(x,y)  is  to  have  the  desired  histogram  p(g)  then  g(x,y)  is  obtained 
from 


g(x,y)  =  r  1  [.{  f  (x,y)|J 


(2-2) 


-1 

L 

s(f) 

/.-CO 


where:  r  [•]  is  the  inverse  function  of  r[*J  ,  and 

f  p(f)df 


(2-3) 

r(g)  P(8)d8  *  (2-4) 

Thus  s(f)  is  the  cummulative  distribution  function  for  intensities  in 
f(x,y),  and  r(g)  is  the  cummulative  distribution  function  for  intensities  in 
g(x,y).  These  functions  are  implemented  digitally  as 

s  (m)  P1>f  (2-5) 


r(n)  «£  (2—6) 

j=0  J  8 

for  m,n  =0,  1,  2  -  255  (8  bit  images).  Then  the  transformation  (2-2)  is 

implemented  with  a  look-up  table. 


2.2.1  Equalization.  Histogram  equalization  is  the  process  whereby  the  output 
histogram  p(g)  has  a  uniform  density  (ie,  a  flat  histogram).  The  resultant 
equalized  image  exhibits  maximum  entropy.  ' 

The  equalization  process  is  accomplished  by  first  computing  the  discrete 
histogram  p,,^  for  i  =  0,  255  of  the  imput  image  f(x,y).  Then  s(m)  is  calculated 
using  (2-5).  The  equalized  output  image  is  then  obtained  from 


g(f) 


s(f) 


255 
*  KL 


(2-7) 


where  KL  is  the  total  number  of  pixels  in  the  image. 


t  w«» 


2.2.2  Hyperbolization.  This  method  produces  an  output  image  whose  histogram 
has  an  hyperbolic  shape  which  emphasizes  the  lower  pixel  values.  It's  importance 


is  derive  from  models  for  human  visual  response.  The  transformation  for 
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hyperbolization  is  given  by 
g(f)  *  c  /  exp 


(f)  -  ejexp  [ta(l  + 


(2-8) 


where  c  is  a  specified  parameter  (larger  values  of  c  provide  more  emphasis  of 
low  pixel  values). 


The  histogram  modification  method  is  outlined  in  Figure  2.2 

a  s(x»y) 


EQN 

(2- 

7) 

CALCULATE 

HISTOGRAM 


CUMULATIVE 

DISTRIBUTION 

FUNCTION 


8  (VS  \£L 

- ^OPTION 


EQN 

(2-8) 


C  ifc”  »• 


2.3  Median  filtering.  A  median  filter  is  one  which  replaces  the  center  pixel 


within  a  window  with  the  median  in  the  window.  It  is  a  non-linear  processor 
which  reduces  noise  and  blemishes  in  the  image  without  as  much  edge  blurring  as 
results  from  low  pass  and  related  smoothing  windows.  The  procedure  is  outlined 
in  Figure  2.3 


f(x,yl 
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-8 
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Figure  2.3  Median  filter 
2 

For  an  n  x  n  window,  n  pixels  must  be  sorted  at  each  window  position. 
For  this  effort  window  sizes  of  (3  x  3)  and  5x5)  were  implemented. 


2.4  Adaptive  low  pass  filtering.  This  method  applies  a  linear  smoothing  filter 
to  the  image  and  adjusts  the  filter  passband  adaptively  dependent  on  the  image 
statistics  in  a  local  window. 

Consider  the  input  image  modeled  in  one  direction  as 

f(x)  *  a  +  bx  +  cx2  +  dx^  (2-9) 

filtered  by  a  low  pass  (averaging)  window  of  width  L  - 


g(x) 


1 

L 


n  = 


f  (n) 

L-l 

2 


(2-10) 


Then  the  error  at  the  center  pixel  due  to  smoothing  is 


-8i9>.- H°> 

L2 

ss 

c 

f  (o) 

12 

a 

(2-11) 
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For  a  specified  error  in  the  center  pixel  value  it  is  possible  to 

calculate  the  required  filter  width  L 

L  »  112  |  -|  e 
c 

where  a  and  c  are  computed  as  least  square  error  estimates  usingq 


(2-12) 


7ga-gc 


a  = 


c  = 


21 

8c“4ga 

84 


where: 


ga=  Z 

a  i  =-3 


f  (i) 


8c  = 


=  Z  [f(i)  +  f(-i)J 


(2-13) 

(2-14) 

(2-15) 


based  on  a  seven  pixel  window |||  is  calculated  for  0°,  90°,  ±45°.  The  largest 
|  |J determines  the  maximum  filter  size  L. 

For  this  effort,  smoothing  windows  of  (3  x  3)  and  (5  x  5)  averages  were 

applied  non-adaptively  to  the  imagery.  Since  significant  blurring  was  notice¬ 
able  for  both  window  sizes,  and  since  (3  x  3)  is  the  smallest  practical 
averaging  window  size,  it  was  suspected  that  the  adaptive  window  would  not 
give  different  results  (eg.  it  would  essentially  always  choose  the  smallest 
window  (3x3)  ). 

The  above  hypothesis  was  tested  by  computing  the  maximum  values  for  L 
across  the  image  using  equations  (2-12),  (2-13),  (2-14)  and  (2-15)  for 
selected  errors.  Except  for  a  few  isolated  pixels,  the  value  of  L  was  always 
less  than  three  and  often  equal  to  one.  As  a  result,  it  was  felt  that  any 
averaging  window  applied  to  the  image  would  degrade  image  quality.  Therefore, 
the  median  filtering  window  was  used  for  subsequent  noise  reduction  processing. 


2.5  Windowing .  Windowing  is  a  technique  whereby  the  input  image  is  convolved 
with  an  n  x  n  (n  odd)  array  of  coefficients.  Smoothing  or  gradient  operations 
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differ  only  in  the  choice  of  coe-ficient  magnitudes  and  signs.  For  the 
pixel  position  (x,y)  at  the  center  of  the  window,  the  output  is 


g(x,y)  =  k  £n  x  C  f(x  +  i,  y  +  j)  (2-16) 

i=-  ~2~  j-  — 

A  number  of  different  sets  of  coefficients  have  been  examined  in  the  literature. 
For  this  effort  two  smoothing  windows  and  four  gradient  operators  were 
implemented . 


2.5.1  Smooth ing.  Image  smoothing  was  implemented  as  an  averaging  window 
convolved  with  the  input  image.  Two  window  sizes  (3  x  3)  and  (5  x  5)  were 
used.  The  algorithm  is 


n-1  n-1 

1  2  2 

g(x,y)  -  -j  21,  L.  .  f(x  +  i,  y  +  j) 
n  3=-  — 


(2-17) 


for  n  =  3  and  n  =  5  . 


2.5.2  Gradient  Processing. 

2. 5. 2.1  Gradient  images.  One  option  on  this  processing  method  is  to  simply 
display  the  gradient  image  as  the  output.  There  are  of  course  several  options 
on  which  gradient  operator  to  use.  For  this  effort,  four  different  methods 
were  used  to  compute  gradient  images. 


1 .  Prewitt  - 

P  °  _11 

gx(x,y)  =  f (x,y)  *  I  1  0  -lj 
g  (x,y)  «  f(x,y)  *  r-i  -1  -1"1 

l?  !  #J 

g(x,y)  =  max  Jg^x.y),  g2(x,y)| 


(2-18) 

(2-19) 

(2-20) 
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V*# 


I 


2.  Sobel  - 

. n  °  -n 


g, (x,y)  =  f (x,y)  *  2  0  -2 

(2-21) 

1  Ll  0  -lj 

r-1  -2  -n 

g  (x,y)  =  f (x,y)  *  0  0  0 

(2-22) 

L  1  2  lj 

y)  =  max  J  g^x.y),  g2(x,y)j 

(2-23) 

3.  Unsharp  mask  -  subtract  smoothed  image  from  original 
g(x,y)  =  f(x,y)  -  f(x, 


1  P  1  *1 

,y)  *  5  ill 

*  ill 

I—  . 


and  g(x,y)  =  f(x,y)  -  f(x,y)*^ 


11111 

11111 

11111 

11111 

11111 


(2-24) 


(2-25) 


4.  Symmetric  -  a  single  pass  gradient  operator 
g(x,y)  =  f(x,y)  * 


-c  -b  — c 
-b  a  -b 
-c  -b  -c 


(2-26) 


t.y)>T  1 

;,y)<  t  J 


(2-27) 


2. 5. 2. 2  Edge  maps.  The  gradient  images  may  be  thresholded  to  produce  a  binary 
edge  map. 

g(x,y)  =  255  if  g(x,y)> 1 
*  0  if  g(x, 

This  was  done  using  two  methods. 

1.  Global  threshold  - 

T  =  m  +  ko  (2-28) 

where  y  and  a  are  the  mean  and  standard  deviation  of  the  total  image. 

2.  Local  threshold  (adaptive)  - 


TAB  =  UAB  +  k0AB 


(2-29) 


where  y^g  and  oAR  are  statistics  in  a  local  A  x  B  window.  The  locally 


AB 


1? 


*r-  •*.  i  c  iv 


-  t 


adaptive  threshold  provides  for  detection  of  less  distinct  edges  that  would 
have  been  suppressed  by  the  sharp  edges  using  a  global  threshold.  The  win¬ 
dow  size  A  x  B  must  be  chosen  as  a  parameter.  For  this  effort,  local 
statistics  were  computed  for  (3x3),  (5  x  5)  and  (15  x  15)  windows. 

2.6  Output  image  combinations.  Several  options  were  exercised  on  combinations 
of  processed  images  and  the  original  image  for  output  display. 

2.6.1  Original  plus  gradient  or  edge.  For  this  option,  two  images  were 
combined  into  one  in  a  way  to  produce  an  output  image  which  utilized  the  full 
dynamic  range  of  gray  levels  (0-255) .  One  method  was  to  simply  add  the  two 
images  and  rescale  the  sum  as  indicated  in  Figure  2.4 
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Figure  2.4  Rescaled  sum  output  image. 

The  problem  with  this  method  is  that  the  re-scaling  is  biased  by  large 
gradient  values.  The  result  is  a  darker  original  image  with  bright  edges. 
To  maintain  the  same  range  of  gray  levels  in  the  original  image  but  with 
bright  edges,  an  edge  replacement  output  option  was  used  as  indicated  in 
Figure  2.5 


h(x,y) 


Figure  2.5  Original  with  edge  replacement 


2.6.2  spr-j a  1  combinations.  For  a  number  of  simulation  runs  the  input  image  was 
subjected  to  two  or  three  processors  applied  serially.  In  these  cases  the 
image  was  re-scaled  to  (0-255)  after  each  process  as  indicated  in  Figure  2.6. 


;(x,y) 


Figure  2.6  Serial  processing 

2.6.3  Parallel  combinations.  For  the  case  of  parallel  combinations  of 
multiple  processors,  the  procedure  outlined  in  Figure  2.7  was  followed  using 
various  values  for  the  parameter  "a". 


(1-a) 


OUTPUT 


Figure  2.7  Parallel  combinations 

Re-scaling  to  a  gray  level  range  of  0-255  was  accomplished  as  shown.  For 
the  case  of  three  processors  combined  in  parallel,  the  multiplication  weights 


were  equal  for  each  image. 

3.  EVALUATION  MEASURES 


3.1  Subjective  methods.  Results  of  the  various  processing  combinations  are 
evaluated  by  subjective  comparisons  and  comments  as  given  in  this  report. 
(Sections  4. and  5.) 

3.2  Quantitative  methods.  The  objectives  for  any  quantitative  evaluation 
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measures  are  that  they  be  directly  relatable  to  improved  performance.  For 

target  acquisition  by  a  human  observer  looking  at  a  CRT  display,  performance 

is  related  to  four  quantitative  image  quality  measures:  S/N,  resolution, 

contrast  and  scene  clutter.  For  autonomous  acquisition  and  correlation  systems, 

performance  is  also  relatable  to  these  image  quality  measures.  The  following 

definitions  may  require  modification  depending  on  the  application;  however, 

they  served  as  first  cut  image  quality  definitions  for  this  effort. 

3.2.1  Contrast .  Contrast  transfer  is  defined  as  the  ratio  of  contrast  in 

the  processed  image  (output)  to  that  of  the  same  area  in  the  unprocessed  (input) 

image.  For  this  application  both  peak  and  average  values  of  modulation  contrast 

over  a  specified  target /background  area  were  calculated. 

M  (output) 

Peak  Contrast  Transfer  C^  =  (input)  (3-1) 

M  (output) 

Average  Contrast  Transfer  C&  «*  (input^ —  (3-2) 

3 


where  M  is  modulation  contrast  defined  by 


Peak: 


M 

P 


f  + 
max 


min 


Average: 


M  = 
a 


fl  +  f2 


where: 

for  target  on  background:  ^max  =  maximum  value  on  target 

f^min  =  minimum  value  on  background 
f^  =  average  target  value 

~  average  background  value 


(3-3) 


There  are  several  options  on  how  to  define  the  background  values  including 


the  following  three: 


a.)  side  by  side 


TARGET  ZONE 


Adjacent  Background 
Zone  of  Equal  Size 


b . )  4  neighbor  average  background 


TARGET  ZONE 


c . )  surrounding  background 


tnickness  =  h/2 


TARGET 


background  consists  of  band  of  pixels 
bordering  the  target  and  with  a  thickness 
one-half  the  target  minimum  dimension 
For  the  simulation  runs  with  images  which  contained  targets  the  procedure 
was  to  locate  the  target,  specify  iSs  size,  then  choose  a  background  option 
and  compute  equations  (3-1)  thru  (3-3).  Contrast  transfer  was  meaningless 
for  image  segments  without  definite  targets  (eg.  tree  background  or  field 
background  only) . 

3.2.2  Resolution.  Resolution  is  typically  specified  most  completely  by  a 
relative  frequency  response.  For  linear  operators  this  is  in  the  form  of  an 
MTF  for  circular  symmetric  systems  and  a  2-D  transfer  function  for  more 
general  processors.  Unfortunately,  only  the  adaptive  low  pass  filter  and  the 
convolutional  window  are  linear  processors.  LAGC,  HIST,  EDGE,  and  MEDIAN  are 
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non-linear  processors  and  will  generate  new  frequencies  in  the  output  image 

which  were  not  present  in  the  input  image.  An  effective  transfer  function 

(plot  of  gain  vs  frequency)  can  be  computed  for  the  non-linear  processors; 

however,  interpretation  may  be  difficult. 

Resolution  measures  given  as  single  parameter  values  such  as  "limiting 

resolution",  MTFA  or  "resolvable  lines  across  the  target  minimum  dimension  " 

have  been  defined  for  simple  resolution  comparisons.  For  relative  ease  of 

comparison  and  because  it  is  the  resolution  parameter  used  in  many  performance 

models,  resolvable  lines  across  the  target  minimum  dimension,  N  ,  was  used 

K 

for  quantitative  comparison  of  the  various  processing  combinations.  More 
detailed  understanding  of  what  a  given  processor  does  to  the  image  in  terms 
of  frequency  content  can  be  evaluated  by  comparison  of  the  image  Fourier 
spectrum,  before  and  after  processing. 

The  procedure  shown  in  Figure  3.1  for  evaluating  resolution  enhancement 
was  implemented.  Resolution  improvement  was  then  computed  as  the  ratios 


R  - 
r 


(limiting  resolution) 


(3-4) 


R 

a 


G(3 )  d  3 


F(g)  d  3 


(resolution  area) 


(3-5) 
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Figure  3.1  Evaluation  of  Resolution 


3.2.3  Signal  -to-noise  ratio.  A  total  signal  model  was  used  which  included 
additive  gaussian  noise. 

r(x,y)  =  f (x,y)  +  n(x,y)  (3- 

The  noise  term,  n(x,y),  was  generated  by  an  approximation  to  a  random 
gaussian  with  zero  mean  and  specified  standard  deviation.  This  number  was 
added  on  a  pixel  by  pixel  basis  to  f(x,y).  Each  processor  was  then  applied  to 
r(x,y)  and  n(x,y).  If  f(x,y)  and  n(x,y)  are  statistically  independent,  then 
their  variances  add  to  give  the  variance  of  r(x,y). 


The  procedure  for  computing  S/N  improvement  is  outlined  in  Figure 


3.2  and  given  by 


SNI  =  Improvement  =  °— Put 

(S/N)  input 


SNI  = 


where  o  is  the 
g 


standard  deviation  of  the  output  image  with  no  noise. 


af  -  computed  from  input  image 

-  specified  (or  computed  to  verify) 

computed  from  processor  application  to  noise  only 

2  2  2  2 

o  -  computed  from  o  -a  +  a  ,  where  o  is  computed 
g  gn  g  n  gn 

from  processor  application  to  signal  plus  noise. 


Figure  3.2  Signal-to-noise  ratio  improvement 


3.2.4  Signal  to  clutter  ratio.  The  definition  of  signal  to  clutter  ratio 
is  complicated  by  difficulties  in  defining  and  measuring  clutter.  This 
parameter  was  included  primarily  to  emphasize  the  fact  that  it  will  affect 
detection  and  recognition  probabilities.  For  this  effort  a  very  simple 
definition  was  used 


o 

s 


where  p  is  the  target  mean  value,  p^  is  the  background  mean  value  and  og  is 
the  standard  deviation  for  a  total  segment  or  image  as  applicable. 

4.  SIMULATION  RESULTS 

4.1  Overview.  A  number  of  single,  serial  and  parallel  processing  mathods  were 
simulated  and  applied  to  typical  TV  and  FLIR  imagery.  The  simulation  plan  and 
processor  combinations  are  described  in  4.1.1  and  the  imagery  is  described  in 
4.1.2  . 

4.1.1  Simulation  plan.  The  six  processing  methods  were  loosely  grouped  into  three 
categories : 

1.  Noise  reduction  (MEDIAN,  ALPF,  WINDOW-SMOOTH); 

2.  S/N,  Contrast  enhancement  (LAGC,  HIST.  MOD, 

WINDOW-GRADIENT); 

3.  Clutter  reduction  (EDGE). 

Actually  EDGE  does  not  just  reduce  clutter;  it  produces  an  edge  image  which 
has  a  significantly  reduced  information  content. 

The  rationale  for  various  serial  and  parallel  combinations  of  the 
processors  was  that  processors  which  do  the  same  thing  (eg.  reduce  noise) 
should  not  be  combined  nor  should  processors  which  have  opposing  effects  be 
combined  (eg.  a  smoothing  window  and  a  gradient  window). 
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Figure  A.l  gives  a  simple  flow  chart  of  the  steps  in  simulation 
evaluation  of  each  individual  processor.  To  reduce  computation  costs, 
many  simulations  were  done  on  smaller  image  segments.  After  initial  evaluation, 
the  better  processors  were  applied  to  the  total  image. 

The  images  and  sub-images  were  characterized  statistically,  plotted 
and  measured  in  terms  of  the  four  quantitative  evaluation  measures  described 
in  3.  After  being  processed,  the  images  were  again  characterized  and  compared 
both  subjectively  and  quantitatively  with  the  unprocessed  images.  The  resultant 
images  were  written  onto  digital  tape  in  a  format  compatible  with  the  MICOM 
display  system.  Processed  sub-images  were  re-inserted  into  the  larger  image 
to  provide  easy  comparison  between  the  original  and  processed  results . 

Simulation  results  shown  in  this  report  are  photographs  taken  of  images 
displayed  on  the  MICOM  system.  Some  image  quality  is  lost  in  the  photo¬ 
graphic  process;  however,  relative  comparisons  can  still  be  made.  With  some 
exceptions,  all  photographs  In  this  report  were  taken  during  a  single  session 
to  ensure  equal  gain  and  contrast  settings  for  the  display  system. 


&  Photo 


Figure  A.l  Evaluation  of  single  processors 
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4.1.2  Image  descriptions.  Initial  processing  was  applied  to  64  x  64  pixel 
image  segments  from  the  POS  B  TADS  TV  WFOV  TGT2  silicon  TV  imagery.  Six 
different  image  segments  were  chosen  representing  various  target  and  back¬ 
ground  conditions  (different  scene  content).  Total  image  processing  was 
applied  to  POS  B  TV  and  FLIR  imagery  and  to  POS  D  TV  and  FLIR  imagery. 

Table  4.1  lists  the  images  and  sub-images. 

Further  descriptions  of  the  imagery  are  given  in  Figures  4.2  thru  4.11. 
Photographs  of  each  image  are  given.  Additionally  the  histogram  and  moments 
are  given. 


Table  4.1  Imagery  for  processor  simulation. 


1  -  POS  B  TADS  TV  WFOV  TGT  2 

(407  x  392  pixels  -  TV  image) 

2  -  IMAGE  SEGMENTS  (64  x  64  pixels)  FROM  IMAGE  1 

-  TARGET/FIELD  BACKGROUND 

-  TARGET /TREE  BACKGROUND 

-  TARGET /TREE-FIELD  MIXED  BACKGROUND 

-  TREE  BACKGROUND 

-  FIELD  BACKGROUND 

-  TARGET  BOARDS /TREE-FIELD  BACKGROUND 

3  -  POS  D  TADS  TV  WFOV  TGT  2 

(407  x  392  pixels  -  TV  image) 

4  -  POS  D  TADS  FLIR  NFOV  TGT  2 

(407  x  392  pixels  -  FLIR  image) 

(white  hot) 


Statistical  characterization  and  quantitative  evaluation  parameters 


for  each  simulation  are  listed  in  Table  4.2. 


Figure  4.2  Original  -  POS  B  TADS  TV  WFOV  TGT  2 


Figure  4.3  Histogram  -  POS  B  TADS  TV  WFOV  TGT 


a)  Target /tree  background 


b)  Target/field  background 


Original  -  FLIR 
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Figure  4.9  Histogram  -  POS  D  TADS  TV  WFOV  TFT 
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4.1.3  List  of  processors.  A  number  of  initial  iterations  for  the  processors 
was  designed  to  evaluate  the  effect  of  parameters  and  combinations  of  processors. 
A  total  of  more  than  200  processing  steps  were  simulated,  and  the  results  are 
available  on  digital  tape.  For  this  report  representative  simulation  results 
were  chosen  to  illustrate  parameter  effects  and  to  provide  inter-processor 
comparisons . 

Table  4.3  lists  image  statistics  and  quantitative  evaluation  parameters 
for  selected  simulations.  Pictorial  results  for  each  processor  listed  in 
Table  4.3  are  included  in  Sections  4.2  and  4.3. 

4.2  Single  Processors. 

4.2.1  Noise  cleaning.  Noise  cleaning  algorithms  included  averaging  windows, 

median  filtering  and  adaptive  low  pass  filtering.  Results  are  illustrated  in 

Figures  4.12  thru  4.17. 

Figure  4.12  illustrates  comparative  results  of  median  filtering  and 
window  averaging  techniques  applied  to  image  segments  from  POS  B  TV.  In  the 
figure,  b.)  and  c.)  are  median  filtered  and  d.)  and  e.)  are  averaged.  Further, 
b.)  and  d.)  used  a  3  x  3  window  while  c.)  and  e.)  used  a  5  x  5  window.  Blurring 
is  more  evident  in  the  averaging  technique  as  expected.  This  effect  is 
illustrated  further  by  Figure  4.14  where  5x5  median  and  averaging  techniques 
were  applied  to  the  total  B  -  TV  and  FLIR  images.  Figure  4.16  shows  the 

5x5  median  processed  D  -  TV  &  FLIR  images  along  with  the  originals  for 

comparison. 

Corresponding  histograms  for  all  images  are  given  in  figures  immediately 
following  the  image  figures. 

4.2.2  Contrast  enhancement.  Contrast  enhancement  techniques  included  histogram 
equalization,  histogram  hyperbolization  and  LAGC.  Figures  4.18  thru  4.23 
illustrate  results  of  these  simulations.  Histogram  equalization  and  hyper¬ 
bolization  are  illustrated  in  Figure  4.18  a.)  and  b.).  This  result  along 
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with  other  simulations  indicated  that  histogram  modification  did  not  produce 

desired  results.  This  was  a  subjective  evaluation  based  on  relative  ease  in 

identifying  known  target  objects  in  the  image.  Figure  4.18  c.)  is  a  3  x  3 

LAGC  applied  to  B-TV  segments  and  d.)  is  a  5  x  5  LAGC  applied  to  the  total 

image.  Figure  4.18  f.)  is  a  5  x  5  LAGC  applied  to  B-FL1R.  The  gain  factor 

for  LAGC  was  G  ■  -  for  these  simulations, 
o 

The  LAGC  method  (G  =  |)  enhances  image  detail;  however,  it  generates 
high  frequency  noise  which  makes  the  image  look  grainy.  This  is  illustrated 
further  in  Figure  4-20  c.)  and  d.)  for  the  D  -  TV  and  FLIR  images.  Increasing 
the  window  size  to  15  x  15  in  4.20  e.)  and  f.)  gave  expected  results,  ie,  contrast 
is  enhanced  most  for  object  sizes  equal  to  the  window  size.  The  resultant 
images  still  exhibit  confusing  graininess. 

An  alternate  gain  factor  (G  «  jj)  was  used  in  the  LAGC  method.  Results 
are  shown  in  Figure  4.22  c.)  and  d.)  for  D  -  TV  and  FLIR  using  a  5  x  5  window 
and  in  e.)  and  f.)  using  a  15  x  15  window.  The  5x5  window  appears  to  give 
slight  contrast  enhancement  and  does  not  exhibit  the  graininess  observed  with 
G  *  ^  .  However,  window  size  for  this  algorithm  becomes  more  critical  as 
illustrated  by  excessive  blurring  for  the  15  x  15  window. 

4.2.3  Gradient  and  edge  processors. 

4.2.3. 1  Gradient  images.  A  number  of  different  gradient  processors  were 
evaluated.  The  results  of  four  processors  applied  to  B-TV  segments  are 
shown  in  figure  4.24  a.)  3x3  Prewitt,  b.)  3x3  Sobel,  c.)  3x3  unsharp 
masking,  and  d.)  5x5  unsharp  masking.  Strong  gradients  are  easily  detected 
by  all  methods.  Further  results  are  given  in  Figures  4.26  and  4.28  for  3x3 
Prewitt  and  3x3  unsharp  masking  applied  to  B-TV  and  FLIR  Images  and  D-TV  and 
FLIR  images  respectively. 
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These  gradient  images  would  certainly  be  useful  for  identifying  distinct 


objects  or  for  image  registration;  however,  without  further  processing  they 
offer  little  help  in  identifying  obscured,  low-contrast  targets. 

4. 2. 3. 2  Thresholded  edge  images.  One  method  for  emphasizing  edges  is  to 
simply  apply  a  threshold  to  the  gradient  image  and  represent  all  edges  above 
threshold  by  a  single  brightness  level.  The  threshold  is  typically  based  on 
global  (total)image  statistics  and  chosen  in  terms  of  either  percentiles  or 
mean  and  standard  deviation. 

Results  of  global  edge  detection  with  a  mean  threshold  are  shown  in 
Figure  4.30  a.)  Prewitt  (3  x  3)  and  b.)  Sobel  (3x3).  Again,  sharp  edges  are 
easily  detected  and  weaker  edges  missed. 

An  approach  which  offered  promise  for  detecting  low  contrast  edges  was 
to  choose  a  threshold  which  was  locally  adaptive  and  based  on  statistics 
within  a  specified  window  about  each  pixel.  Results  of  this  local  edge 
detection  using  the  mean  value  in  a  3  x  3  window  as  threshold  are  shown  in 
Figure  4.30  c.)  Prewitt  and  d.)  Sobel.  This  method  produced  almost  50%  edges 
as  would  be  expected  from  choosing  the  mean  of  a  3  x  3  array  as  a  threshold. 

Low  contrast  edges  were  identified  however,  they  were  obscurred  by  noisy 
edges . 

To  pursue  the  local  edge  detection  method  further,  simulations  were  done 
with  varying  thresholds  and  window  sizes  for  threshold  statistics.  Figure 
4.32  shows  the  result  of  varying  threshold  in  a  3  x  3  window  for  D-TV  and 
FLIR  images  (thresholds  are  a.)  and  b.)  T  +.5a;  c.)  and  d.)  T  *u  +  o; 
e.)  and  f.)T  =u+2a) .  Increasing  the  threshold  does  reduce  the  number  of  edge 
points;  however,  as  illustrated  in  4.32  e.)  and  f.)  it  eleminates  good  edge 
points  and  noise  edge  points  equally.  The  conclusion  was  that  simply  increasing 
the  threshold  would  not  produce  desirable  results. 
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Figures  4.34  and  4.36  show  the  effect  of  window  size  for  statistical 
calculation  of  three  different  thresholds  for  D-TV  and  D-FLIR  respectively.  In 
both  images  the  parameters  are  7x7  window:  a.)  T  =  p  c.)  T  ■  p  +  .5o  e.)  T«p  +  a 
and  15  x  15  windows:  b.)T=pd.)T=p+.5o  f.)  T  =  p  +  o.  Comparison  of 
these  figures  with  4.32  indicates  that  improved  results  were  obtained  using  the 
larger  window  sizes  for  threshold  calculation. 

Further  improvements  in  the  edge  detection  results  could  be  accomplished 
by  edge  thinning  and  edge  connectivity  algorithms;  however,  these  methods  do 
not  operate  in  near  real-time. 

4. 2. 3. 3  Original  plus  edges  or  gradients.  It  was  felt  that  a  potentially 
optimum  output  display  would  result  from  a  combined  original  scene  with  edge 
or  gradient  images  superimposed.  Figure  4.38  shows  the  B-TV  images  (segments 
and  full  images)  with  Prewitt  and  Sobel  gradients  added.  For  this  figure  the 
images  were  summed  and  rescaled  to  (0-255).  Unfortunately,  this  biased  the 
resultant  image  by  setting  the  largest  gradient  value  to  255  and  thus  suppressed 
the  original  image  gray  levels.  This  effect  was  corrected  by  using  an  edge  re¬ 
placement  method  instead  of  summing  the  images.  Figure  4.40  shows  the  original 
D-TV  and  FLIR  images  with  edge  replacement  using  the  Prewitt  local  threshold 

T  =p  +o  edge  images  for  3x3:  a.)  b.)  ;  7  x  7:  c.)  d.);  and  15  x  15:  e.)  f.) 

window  sizes. 

4.3  Multiple  processors.  Serial  and  parallel  combinations  of  processors  were 
implemented  in  an  effort  to  gain  in  more  than  one  quality  measure  (ie.  reduce 
noise,  enhance  contrast,  improve  resolution). 

4.3.1  Serial  combinations.  A  number  of  serial  combinations  were  investigated. 

It  was  found  that  the  errors  introduced  by  one  method  were  generally  carried 
through  subsequent  processing  steps.  Examples  of  serial  processors  are  given 


in  Figure  4.42  a.)  5  x  5  LAGC  followed  by  5  x  5  median  filtering,  b.)  5x5 
averaging  window  followed  by  histogram  equalization,  c.)  and  d.)  5x5  median 
followed  by  5  x  5  LAGC. 

4.3.2  Parallel  processing.  Parallel  combination  of  selected  processors 
seemed  to  produce  the  better  (subjective)  images.  Examples  are  given  for 
B-TV  in  Figure  4.44  a.)  unprocessed  b.)  5  x  5  median  plus  5x5  LAGC  plus 
Prewitt  gradient  c.)  5  x  5  median  (25%)  plus  5x5  LAGC  (75%)  d.)  5x5  median 
(75%)  plus  5x5  LAGC  (25%),  and  for  B-FLIR  in  Figure  4.46  a.)  unprocessed 
b.)  5x5  median  plus  5x5  LAGC  plus  Prewitt  gradient  c.)  5x5  median  (25%) 
plus  5x5  LAGC  (75%)  d.)  5  x  5  median  (75%)  plus  5x5  LAGC  (25%). 


THIS  PAGE  INTENTIONALLY  LEFT  BLANK 


Figure  4.13  Histograms  for  figure  4.12 
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a)  Histogram  eaualization 


b)  Histogram  hvDerbolization 


c)  LAGC  (3  x  3,  G  =  l/o  ) 


Figure  4.18  Histogram  modification  and  LAGC  (G  *  l/o 


i  r. 


d)  LAGC  (5  x  5,  G  -  y/o  ) 


Figure  4.22  D-TV  &  FLIR  LAGC  (G  -  y/o  )  (L  =  5  &  15) 
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c)  Unsharp  mask  (3  x  3) 


d)  Unsharp  mask  (5  x  5) 


Figure  J.lk 


Gradient  processor  comparisons 
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Figure  4.25  Histograms  for  figure  4. 
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a)  B-TV  original 


b)  B-FLIR  original 


e)  Unsharp  mask  (3  x  3)  f)  Unsharp  mask  (3  x  3) 


Figure  4.26  B-TV  &  FLIR  image  gradients 


•  UNM  #  ICJ  *  «l(U)  I 


c.)  Prewitt  (3  x  3) 


d)  Prewitt  (3  x  3) 
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a)  D-TV  original 


b)  D-FLIR  original 


e)  Unsharp  mask  (3  x  3)  f)  Unsharp  mask  (3  x  3) 

Figure  4.28  D-TV  &  FL1R  Image  gradients 
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a)  Prewitt  (global  mean) 


b)  Sobel  (global  mean) 


Figure  4.30  Edge  images  -  global  mean  threshold 


PERCENT  EDGES 


c'  49.08% 


d)  49.41% 


Figure  4.31  Histograms  for  figure  4.30 
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PERCENT  EDGES 


29.91% 


b)  29.33% 


14.86% 


d)  14.18% 


0.58% 


f)  0.43% 


Figure  4.33  Histograms  for  figure  4.32 


PERCENT  EDGES 


45.20% 


b)  41.52% 


27.75% 


d)  26.14% 


15.66% 


f)  15.54% 


Figure  4.35  Histograms  for  figure  4 


.34 


t. 


a)  7  x  7  local,  T  = 


b)  15  x  15  local,  T  *  y 


e)  7  x  7  local,  T  =  g  +  o 

f)  15  x  15  local,  T  »  p  +  o 

Figure  4.36  D-FLIR  edge 

images  -  7  x  7  &  15  x  15  local  thresholds 
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PERCENT  EDGES 


a)  45.66%  b)  42.69% 


c)  27.90%  d)  27.26% 


e)  15.45%  f)  16.47% 


Figure  4.37  Histograms  for  figure  4.36 
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a)  Prewitt 


b)  Sobel 


c)  Prewitt 


d)  Sobel 


Figure  A. 38  B-TV  original  plus  gradients 


65 


^  lit' 


I*  m 


a)  LAGC  (5  x  5)  - Median  (5x5) 


b)  Average  (5  x  5)  - Histogram  equal 


Figure  4.42  B-  TV  serial  processing 


10808 


5088 


0  — L 
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d) 


a)  B-TV  original 


b)  Median  (|)  +  LAGC  (|)  +  Prewitt  (i) 


c)  Median  (.25)  +  LAGC  (.75)  d)  Median  (.75)  +  LAGC  (.25) 


Figure  4.44  B-TV  parallel  processing 
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5.  DISCUSSION  OF  RESULTS  AND  RECOMMENDATIONS 

5.1  Results  comparison.  A  munber  of  comparisons  can  be  made  among  the 
simulation  results  for  the  three  general  processor  categories:  noise  reduc¬ 
tion,  contrast  enhancement  and  clutter  reduction.  Of  the  noise  reduction 
methods  investigated,  the  median  filter  offered  the  most  improvement  without 
image  degradation  (blurring  of  detail).  Window  sizes  of  3  x  3  and  5x5  were 
simulated;  very  little  difference  in  image  quality  was  observable  between  the 
two.  However,  the  5x5  window  did  produce  a  slightly  smoother  image. 

The  LAGC  method  (G= l/o)  for  contrast  enhancement  had  the  problem  that  it 
increased  high  frequency  noise  and  added  clutter  to  the  scene.  Modification 
of  the  gain  term  to  include  the  mean  value  (G  =  \i/a)  greatly  reduced  the  high 
frequency  noise  and  appeared  to  improve  contrast. 

Based  on  the  analysis  in  Appendix  A,  the  optimum  window  size  for  LAGC  is 
equal  to  the  object  size  which  is  being  emphasized.  For  the  case  of  long 
standoff  detection  range,  targets  typically  subtend  only  2-5  pixels.  Therefore, 
if  the  LAGC  is  to  be  implemented  it  should  be  only  for  those  cases  where  the 
target  size  is  small  (2-5  pixels)  and  should  use  a3x3or5x5  window  at  most. 
Simulations  with  a  larger  15  x  15  window  showed  significant  blurring  of  smaller 
image  details  for  the  G  *  p/o  algorithm. 

Of  the  edge  detection  methods  investigated  similar  results  were  obtained 
with  Prewitt  and  Sobel  gradient  operators.  Local  edge  detection  thresholds 
offered  promise  of  pulling  out  weaker  edges  But  showed  sensitivity  to  the 
window  size  used  in  threshold  calculation. 

Serial  combinations  of  processors  typically  produced  results  which  suffered 
from  bad  features  of  each  processor  used.  For  example  an  averaging  window 
(improved  S/N,  blurred  image)  in  series  with  LAGC  (enhanced  contrast/resolution, 
increased  noise  level)  produced  an  image  with  blurred  detail  and  higher  noise. 
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The  serial  processing  option  did  not  produce  improved  images  in  most  cases. 

Parallel  combinations  of  processors  did  produce  enhanced  imagery  considered 
to  be  a  desirable  approach  for  real-time  enhancement  of  image  quality  (for 
target  acquisition) . 


5.2  Recommended  processor (s) .  Based  on  analyses  and  simulation  results  conducted 
during  this  contract  effort,  the  following  processor  options  are  recommended  for 
implementation  into  a  target  acquisition/target  handoff  system. 

Figure  5.1  is  a  block  diagram  of  the  recommended  processor  option.  The 
input  image  f(x,y)  is  median  filtered  to  reduce  noice  without  blurring  edges. 

The  noise  cleaned  image  can  then  be  processed  to  produce  gradient  or  edge  images 
and  to  produce  an  LAGC  image.  Output  options  include  all  possible  combinations 
of  the  noise  cleaned  image,  the  LAGC  image  and  the  gradient  or  edge  image. 

For  target  acquisition  by  a  human  observer,  all  options  should  be  available 
to  the  operator.  Additionally  the  operator  should  have  control  of  window  size 
for  median  filtering  for  edge  detection  and  for  LAGC.  The  coefficients  a,  b  &  c 
allow  output  display  of  any  processed  image  above  or  in  combination  with  other 
images . 


OR 


OUTPUT 

g6c,y) 


Figure  5.1  Recommended  processor  options 
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APPENDIX  A:  LAGC  ANALYSIS 


Local  area  gain  control  is  a  method  whereby  the  gain  applied  to  the  center  pixel 
within  a  window  varies  with  statistics  of  all  pixel  values  within  the  window. 
Variations  of  this  method  have  been  applied  to  forward  looking  infrared  (PLIR) 
imagery  and  analyzed  for  application  to  TV  imagery.  This  Appendix  presents  a 
quanitative  parametric  analysis  and  evaluation  of  one  version  of  the  local  area 
gain  control  processing  method. 

If  the  input  image  f(x,y)  is  processed  using  the  LAGC  to  give  output  image 


g(x,y)  then  the  following  relationship  results. 
g(x.y)  =  G[f(x,y)  -  m^Cx.y)]  +  k®AB(x,y) 


(A-l) 


where:  -m.D(x,y)  is  the  mean  pixel  value  within  an  A  x  B  window  centered  about 
Ad 

pixel  (x,y) . 

-  G  =  C/S._(x,y)  is  the  adaptive  gain  applied  to  the  center  pixel  with  mean 
Ad 

value  removed. 

-S4D(x,y)  is  the  standard  deviation  of  pixel  values  within  the  A  x  B  window. 

Ad 

-C  and  k  are  constants  which  control  the  gain  magnitude  and  relative  mean 
value  added  back  to  the  signal. 

Steps  in  the  procedure  are  shown  in  Figure  A.l  .  LAGC  is  a  non-linear  adaptive 
processor  which  enhances  low  contrast  sub-regions  in  an  image  without  causing  high 
contrast  regions  to  saturate  the  display  dynamic  range.  For  analysis  of  certain 
parametric  effects  a  one-dimensional  model  (input  f(x),  output  g(x)  and  window 
length  L)  is  used  with  simple  sinusoidal  and  square  wave  patterns  as  input  images. 
This  allows  the  evaluation  of  otherwise  complicated  analytical  expressions  and 
gives  results  which  are  easily  relatable  to  standard  MTF  and  bar  pattern  contrast 
measures . 


% 


Figure  A.l.  Local  area  gain  control  (LAGC)  method. 

For  the  LAGC  method  the  following  evaluations  were  accomplised: 

-  Gain  (or  sigma)  dependence  on  window  size  (L)  and  position  (x)  for 
sine  and  square  wave  images 

-  Contrast  transfer  computed  as  the  ratio  of  modulation  contrast  of  g(x) 
and  f(x)  for  sine  and  square  wave  images  (peak  and  average  values  over 
one  period)  as  functions  of  window  size  (L) . 

-  Simulation  with  known  simple  image  waveforms  (sine  and  square) .  Plot 
of  f (x)  and  g(x).  (Various  L  values.) 

-  Simulation  with  typical  TADS  imagery. 

Further  needed  evaluation  includes  an  analyses  of  the  effects  of  noise  and  develop¬ 
ment  of  relationships  showing  depandence  on  scene  spectral  content. 


For  the  one-dimensional  model  equation (A- l)becomes 

gOO  *  Cf(x>  “  mI/x)3  +  n^(x)  • 


(A-2) 


For  a  sine  or  square  wave,  it  is  convenient  to  define  the  window  size  (L)  in  terms 
of  fractions  of  a  period  as  shown  in  Figure  A. 2  .  Then  the  averaging  window  and 
its  Fourier  transform  are  given  by 
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w(x)  «  i  rect  - 
a  a 


W(g)  =  sine  (0a)  ■  sine 


(«H 


(A-3) 

(A-4) 


1 


Calculation  and  removal  of  the  mean  value  is  a  linear  operation  so  that 
sinusoidal  frequency  content  is  preserved  and  we  get  for  the  sine  wave  input 


-  mjU)  -  [l  - 


sine  (L)  sin  2irg  x 


(A-5) 


which  is  a  sine  wave  at  the  same  frequency  with  a  magnitude  determined  by  the 
window  length  (L) .  Integer  values  of  L  (i.e.  multiple  periods)  give  correct 
mean  value  estimates  f  (x)  =  0  and  f(x)  -n^(x)  ■  f(x).  Most  significant  errors 
in  hl(x)  occur  for  L  a  small  fraction  of  the  sine  wave  period. 


Computation  of  sigma  for  the  sine  wave  input  is  accomplished  by 

_  \"|2  *  h 


(x)  =  j|f(x)  ~  *  w(x)| 


Using(A-3)  and  (A-5)  in  (A-6)  gives  for  the  standard  deviation 


s^(x)  =  £l  -  sine  (L)J  -  %  cos  ^2ir  (28Q  )  x 


^  sine  (2L)J 


and  the  gain  for  sine  wave  input  is  the  reciprocal  of  equation  (A-7) . 
Gl(x)  =  l/sL(x) 


(A-6) 


(A-7) 


(A-8) 


A  two  dimensional  perspective  plot  of  s^(x)  vs.  L  and  x  is  shown  in  Figure 
A. 3.  The  surface  is  relatively  smooth  and  approaches  a  value  of  ^2  for  large  L. 
The  figure  shows  only  slight  dependence  on  x.  More  detailed  dependence  is  shown 
if  Figure  A. 4  where  s^(x)  is  plotted  vs.  L  for  selected  values  of  x.  The  gain 
(l/s^(x))  tends  to  blow  up  for  small  values  of  L  which  may  cause  some  processing 
difficulty.  It  is  expected  from  this  analysis, that  the  gain  may  need  to  be 
limited  to  some  maximum  value  even  though,  in  computing  g(x),  Che  high  gain  will 
usually  be  partially  compensated  by  multiplication  with  a  small  difference  signal 
f(x)  -  m^x)  .  This  compensating  effect  is  apparent  in  the  simulations  to  be 
shown  later . 


**\ 

% 

■  4*  I 
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•) .  Sin*  wave  Input . 


b).  Sqi 


Input 


Figure  A. 2  Input  waveforms  and  window  function 


Figure  A. 3  Sigma  for  sine  wave  input 


Figure  A. 4  Sigma  versus  window  size  (sine) 
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For  the  square  wave  input  waveform  a  similar  analysis  is  performed;  the 
major  difference  is  that  the  harmonic  frequency  content  of  the  square  wave 
complicates  expressions  for  s^(x)  and  G^(x).  A  linear  analysis  gives  the  mean 
removed  signal  for  the  square  wave. 


f(x)  -  =n  £  i  Jl  -  sine  (L)j  sin  2TrnfiQx  (A-9) 

n  odd  only 

Then  using  (A-3)  and  (A-9)  and(A-6)  gives  after  some  manipulation  the  square 
wave  standard  deviation 


oo  oo 

s  (x)  =  E  E 
L  n=l  m=l 
n,m  odd  only 


sinc(nL) 


]  [*- 


sinc(mL) 


|  [sine  (n-m)L  cos  ^ 2ti6 ^  (n-m)  x^-  sine  (n+m)L  cos  2irf5Q  (n-fm)x  ]  j  h  (A- 

Figure  A. 5  shows  s^(x)  for  the  square  wave  input  as  a  function  of  L  for 
various  x.  Harmonics  through  n,m=9  were  used  in  the  computation. 


(A-10) 
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and 


!  ft^r) 


(A-12) 


where  f  and  f  ,  are  the  maximum  and  minimum  pixel  values  in  window  L. 
max  min  r 

Definitions  for  f^  and  f^  are  based  on  averages  over  equal  areas  of  light  and 
dark.  For  the  sine  or  square  wave  signals  f^  is  the  average  pixel  value  over 


the  positive  half  period  and  f^  is  the  average  pixel  value  over  the  negative 


half  period. 

Using  these  definitions  for  modulation  contrast  it  is  possible  to  define 


the  contrast  transfer  ratios 
M  (L)  output 

^P^L^  M  (L)  input 


(A-13) 


M  (L)  output 

ci 


Ra^  M  (L)  input 


(A-14) 


Equations  for  and  R^d)  were  simulated  on  a  small  computer.  Results 


are  shown  in  Figure  A. 6  for  both  the  sine  and  square  wave  inputs.  Significant 
features  of  the  result  are  that  even  for  small  values  of  L,  there  is  an  increase 


in  both  peak  and  average  modulation  contrast  (Rp,Ra  )  1)  and  this  increase  levels 


off  at  a  stable  value  for  large  L. 


-•  *  Rp  (tine) 
k  -  Re  (tire) 
e  -  Rp  (tcuere) 
d  -  Re  (tquere) 


Figure  A. 6  Transfer  of  modulation  contrast 
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Figure  A. 7  LAGC  output  (solid  line)  for  sine  input 
(dotted  line)  of  amplitude  1 .0 

Simulation  Results 

Computer  implementation  of  the  LAGC  method  was  accomplished  and  the  method 
was  applied  to  simple  (sine  and  square)  waveforms  for  various  window  sizes  (L) . 


Figure  A. 7  shows  the  simulation  reslults  for  six  different  L  values  for  the 
sine  input.  Both  input  and  output  waveforms  are  shown  (input  is  lower  magnitude 
in  every  case).  Figure  A. 8  shows  similar  results  for  the  square  wave  input. 
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Conclusions 


From  Che  analysis  and  simulation  results  it  is  evident  that  the  LAGC  image 
processing  method  improves  modulation  contrast  and  thus  offers  the  potential 
for  improving  target  detection/recognition  by  an  observer.  It  is  also  clear 
that  the  non-linear  nature  of  the  method  produces  frequency  distortion  which 
depends  on  window  size.  Optimization  of  the  value  of  L  dependent  on  expected 
target  size  is  recommended. 
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